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Specification 

L 

Title of the Invention 

[0001] Endoscope System For Fluorescent Observation 
Background of the Invention 

[0002] The present invention relates to an endoscope system 
which is capable of observing a fluorescence image generated 
by emission of excitation light to an object. 
[0003] Endoscope systems of this type have come into 
widespread use. Japanese Patent Provisional Publication No. 
HEI 8-557 discloses one of such endoscope systems. The 
endoscope system disclosed in this publication includes a light 
source unit which can illuminate an object (e.g. , human tissue) 
with excitation light as well as normal light, and a fiberscope 
(endoscope) . 

[0004] The fiberscope includes an objective lens which 
forms an image, a fiber bundle, and an eyepiece. The image 
formed by the objective lens is transferred through the fiber 
bundle and the eyepiece to an external image intensifier 
provided in an adapter system connected to the fiberscope. The 
image intensifier enhances the image transferred from the fiber 
scope so that image data having sufficient intensity for . 
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observation can be obtained by an image pickup device such as 
a CCD (charge coupled device). 

[0005]. Japanese Patent Provisional Publication No. HEI 
9-70384 also discloses an endoscope system which uses an image 
intensifier to enhance an image formed by an objective lens in 
an endoscope . - 

[0006] However, the endoscope systems disclosed in the 
above mentioned publications require use of the expensive image 
intensifier to obtain the image for fluorescent observation 
(i.e., a fluorescence image), which increases cost of the 
endoscope system. 

[0007] Further, in the endoscope system disclosed in HEI 
8-557, the image formed by the objective lens is transferred 
to the image intensifier via the fiber bundle provided in the 
fiberscope and a fiber bundle provided in the adapter system. 
Such configuration of the endoscope system requires that the 
length of the fiber bundle in the adapter system is as short 
as possible to decrease loss of intensity of the image in the 
fiber bundle of the adapter system. If the length of the fiber 
bundle of the adapter system is set short to avoid such loss 
of image quality, handling of the fiberscope may be limited. 

Summary of the Invention 

[0008] The present invention is advantageous in that it 
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provides an endoscope system which is capable of amplifying an 
image formed by fluorescence emitted from an object. 
[0009] According to an aspect of the invention, there is 
provided an endoscope system, which is provided with an 
endoscope that has an .image pick-up device having a plurality 
of cells for accumulating charge in response to an image formed 
on the plurality of cells, a light source that is capable of 
emitting excitation light, and a controlling system that 
controls the image pick-up device so that charges accumulated 
in two or more of the plurality of cells are added together when 
the excitation light is used. 

[0010] With this configuration, an image for fluorescent 
observation can be amplified without using an expensive image 
intensifier. 

[0011] Optionally, the image pick-up device may include a 
charge coupled device . " 
[0012] In a particular case, the charge coupled device may 
have a frame- transfer architecture . 

[0013] In a particular case, the charge coupled device may 
have an interline architecture. 

[0014] Optionally, the controlling system may include: a 
driver circuit that outputs timing signals to the charge 
coupled device, the charge coupled device outputting charge 
accumulated in the plurality of cells in accordance with the 
timing signals; a detection amplifier that accumulates charge 



3-29; 5 : 1 9 PM ; MAT S UOKA &. Co. 



GreenblumiBernstei ; 0^23725858 



outputted by the charge coupled device and outputs voltage 
levels in accordance with the charge accumulated therein; and 
a correlated double sampling circuit that samples the voltage 
levels outputted by the detection amplifier and outputs a 
sampled signal. 

[0015] Still optionally, the plurality of cells in the 
charge coupled device may be arranged in a matrix, and the 
charge coupled device may include a horizontal transferring 
charge coupled device connected to the plurality of cells in 
the charge coupled device, the horizontal transferring charge 
coupled device output ting the charge to the detection 
amplifier. 

[0016] Still optionally, charge accumulated in each of the 
plurality of cells arranged in the matrix may be transferred 
vertically a plurality of times toward the horizontal 
transferring charge coupled device so that charge of at least 
two cells aligned vertically in the plurality of cells is 
accumulated in each cell of the horizontal transferring charge 
coupled device. 

[0017] Still optionally, charge accumulated in each of the 
cells in the horizontal transferring charge coupled device may 
be transferred horizontally a plurality of times so that charge 
of at least two cells in the horizontal transferring charge 
coupled device is accumulated in the detection amplifier. 
[0018] Still optionally, the driving circuit may transmit 
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reset pulses to the detection amplifier to discharge the charge 
accumulated in the detection amplifier, and may transmit 
sampling signals to the correlated double sampling circuit to 
sample the voltage levels outputted by the detection amplifier. 
In this case, the driving circuit may control timing of the 
reset pulses and the sampling signals so that charge of the at 
least two cells aligned vertically in the plurality of cells 
is accumulated in each cell of the horizontal transferring 
charge coupled device. 

[0019] In a particular case, the endoscope system may 
include an image processing system that generates an image for 
fluorescent observation so that an intensity of one pixel of 
the image corresponds to the added charges of the two or more 
of the plurality of cells. 

[0020] In a particular case, the image pick-up device may 
include a color CCD having color filter covering the plurality 
of cells. In this case, the controlling system may control the 
color CCD so that a number of cells whose charges are added 
together becomes an integral multiple of a number of filter 
elements of the color filter to be used for generating a pixel 
of an image for fluorescent observation. 

[0021] Optionally, the endoscope system may include a 
memory that stores information concerning a repetition pattern 
of the filter elements, and the controlling system may obtain 
the number of filter elements to be used for generating the 
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pixel of the image for fluorescent observation based on the 
information stored in the memory. 

[0022] In a particular case, the image pick-up device may 
. include a color CCD having color filter covering the plurality 
of cells, and the controlling system may control the color CCD 
so that a number of cells whose charges are added together 
becomes an integral multiple of a number of filter elements of 
the color filter to be used for generating a pixel of an image 
for fluorescent observation. In this case, the control system 
may control the color CCD so that a combination of the filter 
elements, to which the two or more cells added together 
correspond, is changed between an odd field and an even field. 
[0023] Optionally, the endoscope system may include an 
image processing system that generates an interlace scan image 
signal so that an intensity of one pixel of the interlace scan 
image signal corresponds to the added charges of the two or more 
of the plurality of cells . 

Brief Description of the Accompanying Drawings 

[0024] Fig. 1 is a block diagram of an endoscope system- 
according to a first embodiment of the invention; 

[0025] Fig. 2 schematically shows a configuration of a CCD 
unit in the endoscope system in Fig. 1; 

[0026] Fig. 3 is a timing chart showing switching of 
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emission of light, and timing of a select signal and timing 
signals ; 

[0027] Fig. 4 is a timing chart showing timing of a 4>V signal, 
a cj)H signal and a reset pulse during a period of non- emission 
period in Fig . 3 ; 

[0028] Fig. 5 is a timing chart showing the timing of the 
<|>H signal and the reset pulse during a period in Fig. 4; 
[0029] Fig. 6 is a timing chart showing the (|>V signal, the 
<|>H. signal and the reset pulse during a period in the 
non-emission period following UV light emission period; 
[0030] Fig. 7 is a timing chart showing the <|>V signal, the 
c|>H signal and the reset pulse during, a period in Fig. 6; 
[0031] Fig. 8 shows a block diagram of an endoscope system 
according to a second embodiment of the invention; 
[0032] Fig. 9 shows a configuration of a CCD unit in the 
endoscope system shown in Fig. 8; 

[0033] Fig. 10 shows another example of the CCD unit having 
an interline architecture; 

[0034] Fig. 11 is a flowchart showing an image processing 
according to the second embodiment; 

[0035] Fig. 12 is a flowchart showing an EEPROM read process 
performed in the image processing shown in Fig. 11; 
[0036] Fig. 13 shows an example of color filter array 
patterns ; 

[0037] Fig. 14 shows another example of the color filter 
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array pattern; 

[0038] Fig. 15 shows another example of the color filter 
array pattern; 

[0039] Fig, 16 is a flowchart showing a normal image 
obtaining process performed in the image processing shown in 
Fig. 11; 

[0040] Fig. 17 is a timing chart showing timing signals 
outputted by a driver circuit when the driver circuit receives 
Px and Py from a MPU; 

[0041] Fig. 18 is a timing chart showing timing within a 
timing period in Fig. 17 in detail; 

[0042] Fig. 19 is a flowchart showing in detail a 
fluorescence image obtaining process performed in the flow of 
Fig. 11; 

[0043] Fig. 20 is a timing chart showing timing signals 
outputted by a driver circuit when Bx and By are transmitted 
from a MPU to the driver circuit; 

[0044] Fig. 21 is a timing chart showing in detail timing 
of the timing signals outputted during a time period in Fig. 

20; 

[0045]. Fig. 22 shows a block diagram of an endoscope system 

according to a third embodiment of the invention; 

[0046] Fig. 23 shows a configuration of a CCD unit in Fig. 

22; 

[0047] Fig. 24 shows another example of a CCD unit having 
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a interline architecture; 

[0048] Fig. 25 is a flowchart showing an image processing 
according to the third embodiment; 

[0049] Fig. 2 6 is a flowchart showing an EEPROM read process 
performed in the image processing shown in Fig. 25; 
[0050] Fig. 27 is a flowchart showing a normal image 
obtaining process performed in the image processing shown in 
Fig. 25; 

[0051] Fig. 28 is a timing chart showing timing signals 
outputted by a driver circuit; 

[0052] Fig. 29 is a timing chart showing timing within a 
timing period in Fig. 28 in detail; 

[0053] Fig. 30 is a flowchart showing in detail a 
fluorescence image obtaining process; 

[0054] Fig. 31 is a timing chart showing the timing signals 

outputted by the driver circuit when Bx, By and FC (FC=1) are 

transmitted from a MPU 601 the driver circuit; 

[0055] Fig. 32 is a timing chart showing in detail the timing 

of the timing signals outputted during a time period Fig. 31; 

[0056] Fig. 33 is a timing chart showing the timing signals 

outputted by the driver circuit when the Bx, By and FC (FC=0) 

are transmitted from the MPU to the driver circuit; 

[0057] Fig. 34 is a timing chart showing in detail the timing 

of the timing signals outputted during a time period in Fig. 

33; 
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[0058] Fig. 35 shows the upper left portion of a CCD on which 
a color filter shown in Fig. 13 is formed, schematically 
illustrating cells which are used to generate one field of the 
fluorescence image when the parameters are FC=1, Ax=2, Ay=2, 
Px=2 and Py=2; and 

[0059] Fig. 36 shows the upper left portion of the CCD on 
which the color filter shown in Fig. 13 is formed, schematically 
illustrating cells which are used to generate one field of the 
fluorescence image when the parameters are FC=0, Ax=2, Ay=2, 
Px=2 and Py=2. 

Detailed Description of the Embodiments 

[0060] Hereinafter, embodiments according to the invention 
arfe described with reference to the accompanying drawings . 

[0061] FIRST EMBODIMENT 

[0062] Fig. 1 is a block diagram of an endoscope system 1 
according to a first embodiment of the invention. The endoscope 
system 1 includes an endoscope (i.e. , an electronic endoscope) 
100, an endoscope processor 200 and a monitor 290. The endoscope 
processor 2 00 is configured to selectively emit light for 
normal observation and excitation light for fluorescent 
observation. An image captured by the endoscope 100 is 
transmitted to the endoscope processor 200 to process the image 
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and to generate a video signal. The video signal is then 
transmitted to the monitor 290 on which the image of an object 
(e.g., human tissue) is displayed. 

[0063] As shown in Fig. 1, the endoscope 100. includes an 
objective lens 101, a CCD unit 110 on which an image is formed 
by the objective lens 101, a fiber bundle (i.e. , a light guide) 
102, a driver circuit 104, and a CDS (Correlated Double 
Sampling) circuit 105. The endoscope processor 200 includes a 
MPU (microprocessor unit) 201, a light source 202, a DSP 
(digital signal processor) 203, a memory 204, an A/D converter 
205, a D/A converter 206 and a clock generator 207. 
[0064] A proximal end portion of the fiber bundle 10 2 is 
connected optically to the light source 202. A distal end of 
the fiber bundle 102 is positioned at a distal end of an 
insertion tube of the endoscope 100. Light emitted from the 
light source 202 is transmitted through the fiber bundle 102 
to illuminate the object from the distal end of the fiber bundle 
102. As described in detail later, the light source 202 emits 
sequentially red light, green light, blue light, and the 
excitation light to obtain color images and fluorescence 
images . 

[0065] The objective lens 101 forms the image of the object 
which is illuminated by light from the light source 202 onto 
a light receiving surface of the CCD unit 110 driven by timing 
signals from the driver circuit 104. 
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[0066] The CCD unit 110 outputs an image signal in 
synchronization with the timing signals from the driver circuit 
104. The image signal corresponding to one frame of the image 
is outputted during each of emission periods of light . During 
the one emission period, one of the red light, green light, blue 
light and excitation light is emitted. 

[0067] The CDS circuit 105 receives the image signal from 
the CCD unit 110 and processes the image signal to generate a 
CDS signal having an appropriate form for the A/D converter 205 . 
The A/D converter 205 process the CDS signal into digitized form. 
The digitized signal is transmitted from the A/D converter 205 
to the DSP 203 in which image processing such as a y-correction 
is performed on the digitized image signal to store the 
processed image signal as image data in the memory 204. 
[0068] In the memory 204, image data respectively 
corresponding to red image data (captured during illumination 
of red light), green image data (captured during illumination 
of green light) and blue image data (captured during 
illumination of blue light), and fluorescence image data 
(captured during illumination of the excitation light) are 
stored. 

[0069] Further, the DSP 203 reads out the image data from 
the memory 204 and combines them. Then, the combined image data 
is processed by the D/A converter 206 having a video encoder 
to generate an analog video signal (e.g. , an NTSC signal) . Then, 
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the video signal is transmitted to the monitor 290. 
[0070] The above mentioned processes are performed under 
control of the MPU 201 which executes various programs stored 
in, for example, a ROM embedded therein. That is, the MPU 201 
controls the light source 202, the DSP 203, the memory 204, the 
A/D converter 205 and the D/A converter 206. For example, a 
sampling rate of the A/D converter 205 is determined by the MPU 
201. The sampling rate determined by the MPU 201 is used by the 
A/D converter 205 to digitize the CDS signal at the sampling 
rate, and is also used by the DSP 203 to generate the image data. 
[0071] The clock generator 207 generates various timing 
signals including a vertical synchronizing signal. The 
synchronizing signals are sent to the driver circuit 104, the 
DSP 203, and the A/D converter 205. The driver circuit 104 
provided in the endoscope 100 generates timing signals based 
on the synchronizing signals from the clock generator 207 and 
sends the timing signals to the CCD unit 110 and the CDS circuit 
105. 

[0072] The CCD unit 110 operates in synchronization with the 
timing signal from the driver circuit 104 to capture the image. 
The CDS circuit 105 processes the image signal from the CCD unit 
110 in synchronization with the timing signal from the driver 
circuit 104. The A/D converter 205 digitizes the CDS signal 
based on the timing signals from the clock generator 207 and 
the determined sampling rate. 
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[0073] The DSP 203 can calculate resolution (i.e., pixel 
numbers in the vertical direction and in the horizontal 
direction) of the image data based on the timing signals and 
the determined sampling rate, and converts the signal from the 
A/D converter 205 into the image data using the calculated 
resolution. 

[0074] Further, based on the synchronizing signals , the MPU 
201 controls the light source 202 to determine timing of 
emission of each of the red light, green light, blue light and 
excitation light. At the timing of the vertical synchronizing 
signal, the type of light is switched to another. Each time each 
of the red light , green light , blue light and excitation light 
is emitted, the image signal corresponding to one frame is 
obtained. 

[0075] Fig. 2 schematically shows a configuration of the CCD 
unit 110. As shown in Fig. 2, the CCD unit 110 includes a CCD 
(charge coupled device) 111, a Floating Diffusion Amplifier 
(i.e. , a charge detection amplifier) 112, and buffer B. As shown 
in Fig. 2, the CCD unit 110 has a frame- transfer architecture. 
However, the CCD unit 110 may be replaced with a CCD unit having 
an interline architecture. 

[0076] The CCD 110 includes a charge accumulation unit 111a 
on which the image is formed by the objective lens 101, a 
horizontal transferring unit 111b, horizontal pulse input 
terminals IH1 and IH2 , and vertical pulse input terminals IV1 



14 



^reeno i umioerns tei ; u c d a / 2 b y 5 a 



and IV2. The charge accumulation unit 111a has a plurality of 
cells llld arranged in a form of n by n pixel matrix. 
[0077] The horizontal transferring unit 111b has a 
plurality of cells llle arranged horizontally in a line and is 
adjacent to a side lllf of the charge accumulation unit Ilia. 
The number of cells llle in the horizontal transferring unit 
111b is equal to the number of cells llld arranged horizontally 
along the side lllf. 

[0078] The cells llle in the horizontal transferring unit 
111b are respectively connected to the cells llld arranged 
along the side lllf. One of the cells llle located at one end 
(i.e., the leftward end in Fig. 2) of the horizontal 
transferring unit 111b is connected to the FDA 112. The 
horizontal pulse input terminals IH1 and IH2 , and the vertical 
pulse input terminals IV1 and IV2 are connected to the driver 
circuit 104 . 

[0079] While the optical image is formed by the objective 
lens 101 on the cells llld, charge is accumulated in each cell 
llld. The amount of charge accumulated in each cell llld depends 
on an accumulation period (i.e., light emission period) and a 
luminance of the optical image. Each time pulses are inputted 
to the vertical pulse input terminals IV1 and IV2, charge 
accumulated in each cell llld is transferred vertically (i.e. , 
downward in Fig. 2) to its neighboring .cell toward the 
horizontal transferring unit 111b. Also, charges accumulated 
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in cells Hid arranged along the side lllf are respectively 
transferred to the cells llle of the horizontal transferring 
unit lllb. 

[0080] Each time pulses are inputted to the horizontal pulse 
input terminals IH1 and XH2. charge accumulated in each cell 
llle is transferred horizontally (i.e.. leftward in Fig^ 2) to 
its neighboring cell llle. Also, charge accumulated in one of 
cells llle located nearest to the FDA 112 is transferred to the 
FDA 112. 

[0081] The FDA 112 converts the charge transferred from the 
horizontal transferring unit lllb to a voltage level. The FDA 
112 has a switch SW which is switched to on or off by control 
of a reset pulse from the driver circuit 104. When the reset 
pulse is inputted to the FDA 112, the charge accumulated therein 
is discharged, and thereafter next accumulation of charge 
starts. The voltage level generated by the FDA 112 is thus 
transmitted to the CDS circuit 105 through the buffer B. The 
buffer B is a wide-band buffer which outputs signal at low 
impedance. Thus, the image signal (i.e. , vout) generated by the 
CCD unit 110 is transmitted to the CDS circuit 105. 
[0082] As described above, the CCD unit 110 may be replaced 
with the CCD unit having the interline architecture. The CCD 
having the interline architecture can be controlled by using 
a control scheme substantially the same as the above mentioned 
control scheme for the CCD having the frame- transfer 
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architecture, as described in detail later in a second 
embodiment with reference to Fig. io. 

[0083] Hereafter, detailed explanations of the timing of 
various signals of the endoscope system 1 will be made with 
reference to Figs. 3-7. Fig. 3 is a timing chart showing the 
switching of the emission of light, the timing of a select 
signal which is transmitted from the MPU 201 to the driver 
circuit 104 . the timing of a pulse (j>H inputted to the horizontal 
pulse input terminals IH1 and IH2, and the timing of a pulse 
<j>V Inputted to the vertical pulse input terminals IV1 and IV2 . 
Further, in Fig. 3, the timing of the reset pulse, and the timing 
of the image signal transmitted from the buffer B to the CDS 
circuit 105 are indicated. 

[0084] As shown in Fig. 3, a sequence of emission of red 
light, green light, blue light and excitation light is repeated 
periodically. In Fig. 3, one of such sequences is indicated for 
the sake of simplicity. As shown in Fig. 3, after the red light 
emission period, a non-emission period is provided, followed 
by the green light emission period, a non-emission period, a 
blue light emission period, a non-emission period, a UV 
(ultraviolet) light emission period (i.e., excitation light 
emission period) , and a non-emission period 

[0085] The select signal is asserted during the UV light 
emission period and the succeeding non-emission period. The 4>V 
signal, the cj>H signal and the reset pulse are asserted only 
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during the non-emission periods. Therefore, the image signal 
is outputted by the CCD unit 110 during the non-emission periods . 
That is , during the non-emission period following the red light 
emission, the image signal of the image formed on the charge 
accumulation unit 111a by the red light emission is outputted. 
During the non-emission period following the green light 
emission, the image signal of the image formed on the charge 
accumulation unit 111a by the green light emission is outputted. 
During the non-emission period following the blue light 
emission, the image signal of the image formed on the charge 
accumulation unit 111a by the blue light emission is outputted. 
[0086] During the non-emission period following the UV 
light emission, the image signal of the image (i.e., the 
fluorescence image) formed on the charge accumulation unit 111a 
by the UV light emission is outputted. 

[0087] Fig. 4 is a timing chart showing the <j)V signal, the 
(j)H signal and the reset pulse during a period °a" of the 
non-emission period indicated in Fig. 3. As shown in Fig. 4, 
the <j>V signal is asserted periodically during the non-emission 
period. Between two cj>V pulses, the <j>H pulses and the reset 
pulses are asserted. Specifically, two kinds of vertical 
synchronizing signals slightly shifted from each other are 
respectively inputted to the vertical pulse input terminals IV1 
and IV2. However, the two kind of vertical synchronizing 
signals are represented by the <j>v signal in the timing charts 
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of this embodiment for the sake of simplicity. 
[0088] Each time one pulse *v is inputted to the CCD unit 
110. the charge accumulated in each cell Hid is transferred 
by one step to its neighboring cell toward the horizontal 
transferring unit lllb. During the one non-emission period, 
pulses <{>V are inputted to the CCD unit 110 - n ' times . It is noted 
that the timing chart of Fig. 4 is also applied to the timing 
during the non-emission periods of "b". and "c" shown in Fig. 
3 respectively following the green light emission period and 
the blue light emission period. 

[0089] Next, detailed timing of the «j,H signal and the reset 
pulse will be described. Fig. 5 is a timing chart showing the 
timing of the cf>H signal and the reset pulse during a period "a' - 
indicated in Fig. 4. As shown in Fig. 5. the cj,H signal is 
periodically asserted n times while the +v signal is low. The 
reset pulse rises in synchronization with rising edge of the 
<}>H signal, and falls before the <j)H signal falls. 
[0090] Following the rising edge of each pulse <h. charge 
is transferred to the FDA 112. and the voltage level (S1.S2.S3 
and S4) corresponding to the charge accumulated in the FDA 112 
is outputted from the FDA 112 until the next reset pulse is 
inputted to the FDA 112. Therefore, charges accumulated in the 
cells Hie of the horizontal transferring unit lllb are 
outputted in synchronization of the pulses <j,H. The voltage 
level (Vout) corresponding to the charge accumulated in the FDA 
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112 is thus outputted from the buffer B to the CDS circuit 105. 

[0091] it is understood from the above mentioned 
explanation that, during each of the red light emission period, 
the green light emission period, and the blue light emission 
period, the image formed on the CCD 111 is outputted as image 
Information having n by n resolution from the CCD unit 110 to 
the CDS circuit 105. 

[0092] Pig. 6 is a timing chart showing the t{)V signal, the 
<|>H signal and the reset pulse during a period "d" (see Fig. 3) 
in the non-emission period following the UV light emission 
period. The driver circuit 104 switches the control of the CCD 
unit 110 in accordance with the select signal from the MPU 201. 
When the select signal is asserted, the control shown in Figs. 
6 and 7 is performed. 

[0093] As shown in Fig. 6, a pair of pulses is periodically 
asserted as the c|>V signal. When the successive two pulses are 
inputted to the CCD unit 110, charge accumulated in each cell 
Hid is transferred vertically by two steps toward the 
horizontal transferring unit illb. That is, when the successive 
two pulses <|>V are inputted to the CCD unit 110, charges 
accumulated in two cells Hid adjacently aligned in the 
vertical direction are added together in each cell llle of the 
horizontal transferring unit 111b. 

[0094] in the interval between two pairs of pulses <J>V, the 
<(>H signal and the reset pulse are asserted periodically. 
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[0095] Fig. 7 is a timing chart showing the <|>V signal, the 
<|)H signal and the reset pulse during a period n d' " in Fig. 6. 
As shown in Fig. 7, the <j>H signal is periodically asserted n 
times while the <j>V signal is low. The reset pulse rises in 
synchronization with rising of each odd-numbered pulse <|)H r and 
falls before the odd-numbered pulse c|)H falls. 
[0096] The <j>H signal is asserted n times while the <{)V signal 
is low. Following the rising of each pulse c|>H, charge is 
transferred to the FDA 112, and the voltage level (S1,S2) 
corresponding to the charge accumulated in the FDA 112 is 
outputted from the FDA 112 until the next reset pulse is 
inputted to the FDA 112. 

[0097] It is noted that the (|)H signal is asserted two times 
during a cycle of the reset pulse, charges of two cells llle 
adjacently aligned in the horizontal transferring unit 111b are 
added together in the FDA 112. Thus, the voltage level (Vout) 
corresponding to the charge accumulated in the FDA 112 is 
outputted from the buffer B to the CDS circuit 105. 
[0098] It is understood from the above mentioned 
explanation that, to the FDA 112, the sum of charges of four 
adjacent cells (2x2 matrix of cells) Hid is transferred. 
Accordingly, intensity of each pixel of the fluorescence image 
can be amplified fourfold in comparison with the normal image. 
The image formed on the CCD 111 is outputted as image 
information having n/2 by n/2 resolution from the CCD unit 110 
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to the CDS circuit 105. 

[0099] As described above, according to the first 
embodiment of the invention, it is possible to amplify 
intensity of the image (i.e. , the fluorescence image) captured 
by the emission of the UV light fourfold without using an 
expensive image intensifier. 

[0100] Although in the above mentioned embodiment charges 
of 2x2 matrix of cells are added together to amplify the 
intensity of the image fourfold, the number of cells added 
together to amplify the fluorescence image can be changed.. 
[0101] For example, if a set of three pulses <{>V is outputted 
in place of the pair of pulses QV shown in Fig . 6 , and if reset 
pulse is outputted each time the <j>H signal is asserted, the 
integration of 1x3 matrix of cells Hid can be attained. In this 
case, the intensity of the fluorescence image can be amplified 
threefold. 

[0102] According to an aspect of the invention, the 
fluorescence image can be amplified at various kinds of scaling 
factors without using the expensive image intensifier. 

[0103] SECOND EMBODIMENT 

[0104] Fig. 8 shows a block diagram of an endoscope system 
2 according to a second embodiment of the invention. As shown 
in Fig. 8, the general configuration of the endoscope system 
2 is similar to that of the endoscope system 1 of the first 
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embodiment. An endoscope (i.e., an electronic endoscope) 300 
has a color CCD, and therefore emissions of three different 
kinds of light are not required to obtain color images in this 
embodiment . 

[0105] As shown in Fig. 8, the endoscope system 2 includes 
the endoscope 300. an endoscope processor 400 and a monitor 490. 
The endoscope 300 includes an objective lens 301, a CCD unit 
310 on which an image is formed by the objective lens 301, a 
fiber bundle (i.e., a light guide) 302. a driver circuit 304, 
a CDS (Correlated Double Sampling) circuit 305, and an EEPROM 
(electrically erasable programmable ROM) 306. The endoscope 
processor 400 includes a MPU (microprocessor unit) 401, a light 
source 402, a DSP (digital signal processor) 403. a memory 404, 
an A/D converter 405, a D/A converter 406 and a clock generator 
407. 

[0106] A proximal end portion 302a of the fiber bundle 302 
is connected optically to the light source 402. A distal end 
302b of the fiber bundle 302 is positioned at a distal end 303a 
of an insertion tube 303 of the endoscope 300. Light emitted 
from the light source 402 is transmitted through the fiber 
bundle 302 to illuminate the object from the distal end 302b 
of the fiber bundle 302. As described in detail later, the light 
source 402 is capable of emitting sequentially normal light and 
the excitation light to obtain color images and fluorescence 
images , respectively . 
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[0107] The objective lens 301 forms the image of the object 
which is illuminated by light from the light source 402 onto 
a light receiving surface of the CCD unit 310 driven by timing 
signals from the driver circuit 304 . 

[0108] The CCD unit 310 outputs an image signal in 
synchronization with the timing signals from the driver circuit 
304. The image signal corresponding to one frame of image is 
outputted by the CCD unit during a time period including one 
emission period of light. 

[0109] The CDS circuit 305 receives the image signal from 
the CCD unit 310 and processes the image signal to generate a 
CDS signal having an appropriate form for the A/D converter 405. 
The A/D converter 405 processes the CDS signal into digitized 
form. The digitized signal is transmitted from the A/D 
converter 405 to the DSP 403 in which image processing such as 
a y- correction is performed on the digitized image signal to 
store the processed image signal as image data in the memory 
404. 

[0110] A frame of image data (captured by emission of normal 
light), and a frame of fluorescence image data (captured by 
emission of the excitation light) are stored in different areas 
of the memory 404. 

[0111] The DSP 403 reads out the image data from the memory 
404, and combines them to display the combined image. Then, the 
combined image data is processed by the D/A converter 406 having 
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a video encoder to generate an analog video signal (e.g., an 
NTSC signal). Then, the video signal is transmitted to the 
monitor 490. 

[0112] The above mentioned processes are performed under 
the control of the MPU 401 which executes various programs 
stored in, for example, a ROM embedded therein. That is, the 
MPU 401 controls the light source 402, the DSP 403, the memory 
404, the A/D converter 405 and the D/A converter 406. For 
example, a sampling rate of the A/D converter 405 is determined 
by the MPU 401. The sampling rate determined by the MPU 401 is 
used by the A/D converter 40 5 to digitize the CDS signal at the 
sampling rate, and is also used by the DSP 403 to generate the 
image data. The MPU 401 uses an area in the memory 401 as a work 
memory . 

[0113] The clock generator 407 generates a vertical 
synchronizing signal. The vertical synchronizing signal is 
sent to the driver circuit 304, the MPU 401, the DSP 403. and 
the A/D converter 405. The MPU 401 generates various control 
signals based on the vertical synchronizing signal to control 
the driver circuit 304. the light source 402, and the A/D 
converter 405 . 

[0114] Under the control of the MPU 401. the switching 
between the normal light emission and the excitation light 
emission, and an initiation of an image capturing operation of 
one frame are synchronized with the vertical synchronizing 
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signal. The DSP 403 can determine which portion of the image 
signal sent from the endoscope 300 corresponds to one frame. 
[0115] The driver circuit 304 provided in the endoscope 300 
generates the timing signals based on the synchronizing signal 
from the clock generator 407 and sends the timing signals to 
the CCD unit 310 and the CDS circuit 305. 

[0116] In the EEPROM 306 of the endoscope 300, information 
regarding the CCD unit 310 is stored. The information of the 
CCD unit 310 is read out by the MPU 401, and is used for the 
control of the DSP 403, the driver circuit 304, and the CDS 
circuit 305. 

[0117] Fig. 9 shows a configuration of the CCD unit 310. The 
CCD unit 310 has the same architecture (i.e. , a frame-transfer 
architecture) as the CCD unit 110 of the first embodiment shown 
in Fig. 2. Therefore, to some elements which are the same as 
those shown in Fig. 2, same numbers are assigned. 
[0118] As shown in Fig. 9, the CCD unit 310 includes a color 
CCD (charge coupled device) 311 , a Floating Diffusion Amplifier 
(i.e. . a charge detection amplifier) 312, and buffer B. The CCD 
311 includes a light receiving unit 311a on which the image is 
formed by the objective lens 301, a horizontal transferring CCD 
(HCCD) 311b, horizontal pulse input terminals IH1 and IH2 , and 
vertical pulse input terminals IV1 and IV2 . 

[0119] The light receiving unit 311a has a plurality of 
cells 311d arranged in a form of M by N pixel matrix. That is, 
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the light receiving unit 311a has M rows of cells 3 lid and N 
columns of sells 311d. 

[0120] The HCCD 311b has N cells 311e arranged horizontally 
in a line and is adjacent to a side 31 If of .the light receiving 
unit 311a. The number of cells 311e in the HCCD 311b is equal 
to the number of cells 311d arranged horizontally along the side 
311f. 

[0121] The cells 311e in the HCCD 311b are respectively 
connected to the cells 3 lid arranged along the side 311f. One 
of the cells 311e located at one end (leftward end in Fig. 9) 
of the HCCD 311b is connected to the FDA 312. 
[0122] The horizontal pulse input terminals IH1 and IH2 , and 
the vertical pulse input terminals IV1 and IV2 are connected 
to the driver circuit 304, and receive the timing pulses from 
the driver circuit 304. Each of the vertical pulse input 
terminals IV1 and IV2 is connected to each cell 3 lid. Each of 
the horizontal pulse input terminals IH1 and IH2 is connected 
to each cell 3 lie in the HCCD 311b. 

[0123] While the image is formed by the objective lens 301 
on the cells 311d # charge is accumulated in each cell 3 lid. The 
amount of charge accumulated in each cell 31 Id depends on the 
accumulation period and a luminance of the optical image. Each 
time a pair of pulses are inputted to the vertical pulse input 
terminals IV1 and IV2, charge accumulated in each cell 3 lid is 
transferred vertically (i.e., downward in Fig. 9) to its 



27 



neighboring cell toward the HCCD 311b. Also, charges 
accumulated in cells 311d arranged along the side 311f are 
respectively transferred to the cells 3 lie of the HCCD 311b. 
[0124] In this embodiment, charge is transferred vertically 
based on the two-phase transferring technology. However, 
another technology, such as a single phase transferring 
technology, three-phase transferring technology, and 
four-phase transferring technology well known in the art, may 
be adopted to transfer charge vertically. 

[0125] Each time pulses are inputted to the horizontal pulse 
input terminals IH1 and IH2, charge accumulated in each cell 
311e is transferred horizontally (i.e. , leftward in Fig. 9) to 
its neighboring cell. Also, charge accumulated in one of cells 
311e located nearest to the FDA 312 is transferred to the FDA 
312. In this embodiment, charge is transferred horizontally in 
HCCD 311b based on the two-phase transferring technology. 
However, another technology, such as a single phase 
transferring technology, three-phase transferring technology, 
and four-phase transferring technology well known in the art, 
may be adopted to transfer charge horizontally in the HCCD 311b. 
[0126] The FDA 312 accumulates the charge transferred from 
the horizontal transferring CCD 311b until a next reset pulse 
is inputted thereto. The FDA 312 outputs a voltage level 
corresponding to the charge accumulated therein. The FDA 312 
has the switch SW which is switched to ON or OFF by control of 
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the reset pulse from the driver circuit 304. 

[0127] When the reset pulse is inputted to the FDA 312, the 
charge accumulated therein is discharged, and thereafter next 
accumulation of charge starts. The voltage level generated by 
the FDA 312 is transmitted to the CDS circuit 305 through the 
buffer B. The buffer B may have the function of amplifying the 
voltage inputted therein. Thus, the image signal (i.e., Vout) 
generated by the CCD unit 310 is transmitted to the CDS circuit 
305 . 

[0128] The CDS circuit 305 samples the image signal from the 
CCD unit 310 two times per one reset pulse (i.e. , at a timing 
just after output of the reset pulse and at a timing just before 
output of the next reset pulse) to obtain a difference between 
amplitudes of the two values sampled between the reset pulse 
and the next reset pulse. The difference is outputted from the 
CDS circuit 305 to the A/D converter 405 . According to the above 
mentioned operation of the CDS circuit 305, 1/f noise and reset 
pulse noise can be eliminated from the image signal outputted 
by the CDS circuit 305. 

[0129] Although in this embodiment the CCD 311 has the 
frame -transfer architecture, a CCD having an interline 
architecture may be used in place of the CCD 311. Fig. 10 shows 
a CCD unit 1110 which adopts the interline architecture. The 
CCD unit 1110 includes a CCD 1111 having the interline 
architecture, a Floating Diffusion Amplifier (i.e., a charge 
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detection amplifier) 1112, and a buffer B. 

[0130] The CCD 1111 includes N columns of light receiving 
linens 1111a on which the image is formed by the objective lens 
301, a horizontal transferring CCD (HCCD) 1111b, vertical 
transferring CCDs (VCCD) llllh, horizontal pulse input 
terminals IH1 and IH2 , and vertical pulse input terminals IV! 
and IV2. As shown in Fig. 10, each light receiving line 1111a 
has M cells lllld aligned vertically. That is, the CCD 1111 has 
the M by N matrix of cells lllld for receiving light from the 
object . 

[0131] Neighboring to each light receiving line 1111a, one 
vertical transferring CCD (VCCD) llllh is located. The VCCD 
llllh also includes M rows of cells lllli aligned vertically. 
Cells lllld in each light receiving line 1111a are respectively 
connected to the cells lllli in the neighboring VCCD llllh. 
Areas of the VCCDs llllh are covered with optical shielding, 
and light from the object is not incident on the VCCDS llllh. 
Therefore, only the cells lllld of light receiving lines 1111a 
receive light from the object. 

[0132] The HCCD 1111b is located along one side llllf of the 
CCD 1111. The HCCD 1111b has N cells lllle which are aligned 
in a line horizontally and which respectively correspond to the 
VCCDs llllh. One of the cells lllle located at one end (leftward 
end) of the HCCD 1111b is connected to the FDA 1112. 
[0133] As in the case of the CCD 311 having the 
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frame -transfer architecture, the horizontal pulse input 
terminals IH1 and IH2 , and the vertical pulse input terminals 
IV! and IV2 are connected to the driver circuit 304, and receive 
the timing pulses from the driver circuit 304. Each of the 
vertical pulse input terminals IV1 and IV2 is connected to each 
cell 11 lid. Each of the horizontal pulse input terminals IH1 
and IH2 is connected to each cell lllle of the HCCD 1111b. 
[0134] While the image is formed by the objective lens 301 
on the cells lllld, charge is accumulated in each cell lllld. 
The amount of charge accumulated in each cell lllld depends on 
the accumulation period and a luminance of the optical image. 
Each time pulses are inputted to the vertical pulse input 
terminals IV1 and IV2 , charge transferred from each cell lllld 
to each cell lllli is transferred vertically (i.e., downward 
in Fig. 10) to its neighboring cell toward the HCCD 1111b. Also, 
charges accumulated in cells lllli arranged along the side 
llllf are respectively transferred to the cells lllle of the 
HCCD 1111b. 

[0135] In this example shown in Fig. 10, charge is 
transferred vertically based on the two-phase transferring 
technology. However, another technology, such as a single phase 
transferring technology, three-phase transferring technology, 
and four-phase transferring technology well known in the art, 
may be adopted to transfer charge vertically. 
[0136] Each time a pair of pulses are inputted to the 
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horizontal pulse input terminals IH1 and IH2, charge 
accumulated in each cell lllle is transferred horizontally 
(i.e., leftward in Fig. 10) to its neighboring cell. Also, 
charge accumulated in one of cells lllle located nearest to the 
FDA 1112 is transferred to the FDA 1112. In this example, charge 
is transferred horizontally based on the two -phase 
transferring technology. However, another technology, such as 
a single phase transferring technology, three-phase 
transferring technology, and four-phase transferring 
technology well known in the art, may be adopted to transfer 
charge horizontally. 

[0137] As described above, the CCD unit 1110 can be 
controlled in the same way as that of the CCD unit 310. Functions 
of the FDA 1112 and the buffer B are the same as those shown 
in Fig. 9, detailed explanation thereof will not be repeated. 
[0138] Hereafter, an image processing performed under 
control of the MPU 401 provided in the endoscope processor 4 00 
will be described. As described below/ images for normal 
observation (i.e., color images) and images for fluorescent 
observation (i.e., fluorescence images) are obtained in the 
image processing. Fig. 11 is a flowchart (a main flow) showing 
the image processing. A program of the image processing is 
stored in the embedded ROM and is read out by the MPU 401. 
[0139] Firstly, the MPU 401 determines whether power of the 
endoscope 300 is ON or OFF (step S101) . When the power of the 
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endoscope 300 is OFF (S101.-NO), the MPU 401 repeats the step 
S101. When the power of the endoscope 300 is ON (S101:YES), 
control proceeds to step S102. 

[0140] In step S102, the MPU 401 reads out information from 
the EEPROM 306 and assigns various parameters to variables. 
Next, in step S103, the image for the normal observation is 
obtained. Next, in step S104 , the image for the fluorescent 
observation is obtained. 

[0141] In step S105, the image for normal observation 
obtained in step S103 and the image for the fluorescent 
observation obtained in step S104 are combined. Then, the 
combined image is converted to the video signal and is outputted 
to the monitor 490. Next, in step S106, the MPU 401 determines 
whether the power of the endoscope 300 is OFF or ON. 
[0142] When the endoscope 300 is ON (S106:NO), control 
returns to step S103 to obtain a next frame of the image. When 
the endoscope 300 is OFF (S106:YES), the image processing 
terminates. According to the image processing shown Fig. 11, 
both of the image for the normal observation and the image for 
the fluorescent observation can be obtained and are displayed 
on the monitor 490. 

[0143] Fig. 12 is a flowchart showing an EEPROM read process 
performed in step S102 of Fig. 11. 

[0144] Firstly, in step S201, the MPU 401 obtains the number 
of cells 311d provided in the light receiving unit 311a. More 
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specifically, the MPU 401 obtains the number of cells 311d in 
one row (i.e., the cells 311d aligned in the horizontal 
direction) and the number of cells 3 lid in one column (i.e., 
the cells 3 lid aligned in the vertical direction) from the 
EEPROM 306. The MPU 401 assigns the number of cells 311d in one 
row to a variable Pnx # and assigns the number of cells 3 lid in 
one column to a variable Pny. 

[0145] As described above, in this embodiment, the cells 
3 lid aligned in M by N matrix. The number N is assigned to the 
Pnx and the number M is assigned to the Pny. 

[0146] On cells 311d of the color CCD 311, a color filter 
is formed. Fig. 13 shows an example of color filter array 
patterns. The color filter shown in Fig. 13 has repetitions of 
a color group 91 which has a green color element G and 
complementary color elements of magenta Mg, yellow Ye and cyan 
Cy. When the image for the normal observation is obtained, one 
pixel of the image is formed by four cells 3 lid corresponding 
to four filter elements of Mg, Ye, Cy and G in one group 91. 
[0147] in step S202, information concerning a repetition 
pattern of the filter elements of the color filter is read out 
from the EEPROM 306. More specifically, the information 
concerning the repletion pattern includes the number of filter 
elements arranged in the horizontal direction in one group 91, 
and the number of filter elements arranged in the vertical 
direction in one group 91. 
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[0148] In the case of the color filter shown in Fig. 13, the 
number of filter elements arranged in the horizontal direction 
in one group 91 is 2, and the number of filter elements arranged 
in the vertical direction in one group 91 is 2. These obtained 
numbers (2, 2) are stored in variables (AX, Ay), respectively. 
[0149] Fig. 14 shows another example of the color filter 
array pattern. The color filter shown in Fig. 14 has repetitions 
of a color group 92 which has two green color elements G, a red 
color element R and a blue color element B. When the image for 
the normal observation is obtained, one pixel of the image is 
formed by four cells 311d corresponding to four filter elements 
of R, G, G and B in one group 92. In the case of the color filter 
shown in Fig. 14, the number of filter elements arranged in the 
horizontal direction in one group 9 2 is 2, and the number of 
filter elements arranged in the vertical direction in one group 
92 is 2. Therefore, these obtained numbers (2, 2) are assigned 
to variables (AX, Ay), respectively. 

[0150] Fig. 15 shows another example of the color filter 
array pattern. The color filter shown in Fig. 15 has repetitions 
of a color group 93 which has a red color elements R, a green 
color element G and a blue color element B. The color filter 
array pattern shown in Fig. 15 is frequently called a RGB stripe 
array . 

[0151] When the image for the normal observation is obtained, 
one pixel of the image is formed by three cells 311d 
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corresponding to three filter elements of R, G and B in one group 
93. In the case of the color filter shown in Fig. 15, the number 
of filter elements arranged in the horizontal direction in one 
group 93 is 3, and the number of filter elements arranged in 
the vertical direction in one group 93 is 1. Therefore, these 
obtained numbers (3, 1) are assigned to variables (AX, Ay), 
respectively . 

[0152] After the information concerning the repetition 
pattern of the filter elements is obtained in step S202, control 
proceeds to step S203. In step S203, the MPU 401 obtains an ID 
number indicating the type of the color filter array pattern 
of the color filter in the color CCD 310 from the EEPROM 306. 
[0153] For example, the ID number of the type of the color 
filter array pattern is zero when the color filter shown in Fig. 
13 is used, the ID number of the type of the color filter array 
pattern is 1 when the color filter shown in Fig. 14 is used, 
and the ID number of the type of the color filter array pattern 
is 2 when the color filter shown in Fig. 15 is used. The ID number 
of the type of the color filter array pattern is stored in a 
variable Pt . 

[0154] After step S203 is processed, control returns to step 
103 of the main flow (Fig. 11). 

[0155] Fig. 16 is a flowchart showing a normal image 
obtaining process performed in step S103 of the main flow (Fig. 
11). Firstly, in step S301, pixel addition parameters are 
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assigned to Px and Py (i.e., 1 is assigned to each of the 
variables Px and Py) . Next, in step S302, normal light (i.e., 
white light) is emitted by the light source 402. 
[0156] In step S303, the values of Px and Py are sent to the 
driver circuit 304. The driver circuit 304 uses the Px and Py 
to generate timing signals to be inputted to the CCD unit 310 
and the CDS circuit 305. By performing the step S303, one frame 
of the image signal is outputted by the CDS circuit 305 to the 
A/D converter 405. 

[0157] In step S304, the MPU 401 controls the A/D converter 
405 and the DSP 403 to convert the image signal to image data. 
The image data is then stored in the memory 404. Various 
parameters obtained in step S102 in the main flow are used in 
the conversion step S304 . Hereafter, the digitized image signal 
corresponding to one frame is represented by pixel data P(x,y) 
where 0=sx<Pnx, 0^y<Pny. 

[0158] The DSP 403 converts the pixel data P(x,y) to red, 
green and blue component image data of R(x,y) , G(x,y) and B(x,y) . 
More specifically, R(x,y) represents a red component intensity 
value of a pixel having coordinates (x,y) . G(x,y) represents 
a green component intensity value of a pixel having coordinates 
(x,y). Further, B(x,y) represents a blue component intensity 
value of a pixel having coordinates (x,y) . 

[0159] When the color filter shown in Fig. 13 is used (i.e. , 
if Pt=0), the DSP 403 determines R(x,y) ,G(x,y) and B(x,y) 
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according to the following equation (1) 

P(x,y) \ 
P{x + \y) 

v P(x + l 3 y+l)J 
where 0^x<(Pnx-l) , 0<;y < { Pny- 1 ) . 

[0160] In the equation (1), matrix factors Krl , Kr2 , Kr3 , 

Kr4, Kgl, Kg2 , Kg3 , Kg4, Kbl, Kb2, Kb3 , Kb4 are adjusted in 
accordance with luminosity characteristics. Also, the matrix 
factors change depending on the type of the color filter. That 
is, the matrix factors change depending on the types of the 
filter elements on the cells corresponding to P(x,y) , P(x+l,y) , 
P(x,y+1) and P(x+1, y+1). 

[0161] The digital image data of one pixel is thus obtained 
from charges accumulated in four cells 3 lid according to the 
equation ( 1) . 

[0162] When the color filter shown in Fig. 14 is used (i.e. , 
if Pt=l), the DSP 403 determines R(x,y) ,G(x,y) and B(x,y) 
according to the following equations (2), given that 
0<ac<(Pnx-l) , 0sry<(Pny-l) . in the following equations, the 
green filter element (G) adjoining to the red filter element 
(R) in the horizontal direction is defined as a Gr filter 
element, and green filter element (G) adjoining to the blue 
filter element (B) in the horizontal direction is defined as 
a Gb filter element. 

[0163] If the red filter element (R) is located on the cell 
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corresponding to the P(x»y), R(x.y) ,G(x.y) and B(x,y) are 

determined as follows . 

R(x,y)=P(x,y) 

G(x,y)=[P(x,y-l)+P(x-l ,y ) +P ( x+1 ,y ) +P (x, y+1 ) ] /4 

B(x,y)=[P(x-l,y-l)+P(x+l,y-l)+P(x-l,y+l)+P(x+l,y+l) ]/4 

If the Gr filter element is located on the cell corresponding 

to the P(x,y), R(x,y) ,G(x,y) and B(x,y) are determined as 

follows. 

R(x,y)=[P(x-l,y)+P(x+l,y) ]/2 
G(x,y)=P(x,y) 

B(x,y)=[P(x,y-l)+P(x,y+l) ]/2 

If the Gb filter element is located on the cell corresponding 
to the P(x,y), R(x,y) ,G(x,y) and B(x.y) are determined as 
follows . 

R(x,y)=[P(x,y-l)+P(x,y+l) ]/2 
G(x,y)=P(x,y) 

B(x,y)=[P(x-l,y)+P(x+l,y) ]/2 

If the blue filter element (B) is located on the cell 
corresponding to the P(x,y), R(x,y) ,G(x,y) and B(x,y) are 
determined as follows . 

R(x,y)=tP<x-l # y-l)+p(x+l,y-l)+P(x-l,y+l)+P(x+l,y+l) ]/4 
G(x,y)=[P(x»y-l)+P(x-l,y)+P(x+l,y)+P(x,y+l) ]/4 
B(x,y)=P(x.y) 

(2) 

[0164] The digital image data of one pixel when the color 
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filter shown in Fig. 14 is used is thus obtained from charges 
accumulated in four cells 31 Id according to the above 
equations . 

[0165] When the color filter (RGB stripe array) shown in Fig. 
15 is used (i.e., if Pt=2), the DSP 403 determines 
R(x,y) ,G(x,y) and B(x,y) according to the following equations 
(3), given that 0:sx< (Pnx-1 ) , 0<;y< ( Pny-1 ) . 

[0166] If the red filter element (R ) is located on the cell 

corresponding to the P(x,y), R(x,y) ,G(x,y) and B(x,y) are 

determined as follows. 

R(x,y)=P(x,y) 

G(x,y)=P(x+l,y) 

B(x,y)=P(x-l,y) 

If the green filter element (G) is located on the cell 

corresponding to the P(x,y), R(x,y) ,G(x,y) and B(x,y) are 

determined as follows. 

R(x,y)=P(x-l,y) 

G(x,y)=P(x,y) 

B(x,y)=P(x+l,y) 

If the blue filter element (B) is located on the cell 

corresponding to the P(x,y), R(x,y) ,G(x,y) and B(x,y) are 

determined as follows . 

R(x,y)=P(x+l,y) 

G(x,y)=P(x-l.y) 

B(x,y)=P(x,y) 
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(3) 

[0167] The digital image data of one pixel when the color 
filter shown in Fig. 15 is used is thus obtained from charges 
accumulated in three cells 3 lid according to the above 
equations . 

[0168] After the above mentioned calculation is performed 
in step S304 of Fig. 16, the normal image obtaining process 
terminates, and control returns to step S104 of the main flow 
(Fig. 11). 

[0169] Next, operation of the driver circuit 304, the CDS 
305 and CCD unit 310 when the MPU 401 sends the Px and Py to 
the driver circuit 304 in step S303 of Fig. 16 will be explained. 
Fig. 17 is a timing chart showing the timing signals output ted 
by the driver circuit 304 when the driver circuit 30 4 receives 
the Px and Py from the MPU 401. That is, the timing chart shows 
operation when the normal image is obtained. 

[0170] As shown in Fig. 17, the driver circuit 304 outputs 
a <|>V1 signal, a <|>V2 signal, a <J>H1 signal, a <j>H2 signal and a 
(J>R signal (i.e. , the reset pulse) . The (j>Vl signal and the $V2 
signal are respectively inputted to the vertical pulse input 
terminals IV1 and IV2 of the CCD unit 310. The <j>Hl signal and 
the c|)H2 signal are respectively inputted to the horizontal 
pulse input terminals IH1 and IH2 . The <j>R signal is inputted 
to the switch SW of the FDA 312. 

[0171] As shown in Fig. 17, when a pair of successive one 
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<j)Vl pulse and one <|>V2 pulse is inputted to the input terminals 
IV1 and IV2, charge accumulated in each cell 311d is transferred 
vertically (i.e., downward in Fig. 9) to its neighboring cell 
311d. Then, by respectively inputting the <J)H1 pulses and cj)H2 
pulses to the input terminals IH1 and IH2 , charge accumulated 
in each cell 311e in the HCCD 311b is outputted from the HCCD 
311b to the FDA 312. Further, by inputting the <}>R pulses to the 
CCD unit 310, the image signal is sent from the CCD unit 310 
to the CDS circuit 305. 

[0172] Fig. 18 is a timing chart showing the timing within 
a timing period "a" of Fig. 17 in detail. As shown in Fig. 18, 
the <f>R pulses are inputted to the CCD unit 310 in 
synchronization with the <j>Hl pulses. Also, in Fig. 18, CDS 
pulses 1 and 2 which are sent from the driver circuit 304 to 
the CDS circuit 305 are indicated. 

[0173] The CDS circuit 305 samples the image signal from the 
CCD unit 310 when the CDS pulse 1 is inputted thereto and when 
the CDS pulse 2 is inputted thereto. Then the CDS circuit 305 
obtains a difference between amplitude of the image signal when 
the CDS pulse 1 is inputted and amplitude of the image signal 
when the CDS pulse 2 is inputted. 

[0174] More specifically, the CDS pulse 1 is asserted Just 
after the falling edge of the <|>R pulse, and the CDS pulse 2 Is 
asserted just before the rising edge of the next c()R pulse. 
Synchronizing with the falling edge of the <j>H2 pulse, charge 
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accumulated in each cell 311e of the HCCD 311b Is transferred 
to its neighboring cell. The FDA 312 accumulates charge from 
the cell 311e of the HCCD 311b. The FDA 312 outputs the voltage 
level corresponding to the charge accumulated therein. 
Consequently, a signal Vout (i.e., the image signal) 
corresponding to the charge accumulated in the FDA 312 is 
outputted from the buffer B to the CDS circuit 305. 
[0175] According to the above mentioned operation of the CCD 
unit 310 and the CDS circuit 305, the difference between 
amplitude of the image signal sampled when the CDS pulse 1 is 
asserted and amplitude of the image signal when the CDS pulse 
2 is asserted appropriately indicates the voltage level 
corresponding to charge accumulated in the FDA 312. 
[0176] That is, the CDS circuit 305 outputs voltage levels 
respectively corresponding to voltage levels of SI, S2, S3 and 
S4 shown in Fig. 18. As shown in Fig. 18, one <|>R pulse is asserted 
per one <j>Hl pulse. Therefore, each of voltage levels SI, S2 , 
S3 and S4 corresponds to charge accumulated in one cell 311e. 
[0177] As describe above,. Charge accumulated in one cell 
311d is transferred to each cell 311e of the HCCD 311b when the 
pair of signals <|>V1 and <j)V2 is asserted. Therefore, each of the 
voltage levels of Sl r S2 , S3 and S4 shown in Fig. 18 corresponds 
to one cell 311d of the light receiving unit 311a. 
[0178] Consequently, the CDS circuit 305 sequentially 
outputs voltage levels respectively corresponding to charges 
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in the cells 311d. 

[0179] Fig. 19 is a flowchart showing in detail a process 
of obtaining the image for the fluorescence observation 
(hereafter, referred to as a fluorescence image obtaining 
process) performed in step S104 of Fig. 11. 

[0180] Firstly, in step S401, pixel addition parameters are 
assigned to Px and Py. The pixel addition parameters represent 
the number of pixels of the normal image to be added together 
for generating one pixel of the fluorescence image. 
[0181] For example, if Px=2 and Py=3, intensities of two 
cell groups (e.g., two color groups 91 in Fig. 13) aligned in 
the horizontal direction and intensities of three cell groups 
aligned in the vertical direction are added together, and the 
sum is used as an intensity of one pixel of the fluorescence 
image. That is, 2 by 3 pixel groups are used to generate one 
pixel of the fluorescence image . The pixel addition parameters 
may be set by a user to the endoscope processor 400 for example 
by user operation. 

[0182] As described above, one color group (e.g. , the color 
group 91 in Fig. 13) of the color filter has different types 
of color filter elements. It is noted that the different types 
of color filter elements have different transmissivity . 
Therefore, in order to match a gray scale of the fluorescence 
image to a real image of the object, the number of cells 3 lid 
used for generation of one pixel of the fluorescence image has 
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to be integral multiples of the number of cells 311d included 
in one color group. 

[0183] That is, the number of cells 3 lid in the horizontal 
direction used to generate one pixel of the fluorescence image 
has to be integral multiples of the number of cells 31 Id in the 
horizontal direction used to generate one pixel of the normal 
image. Also, the number of cells 31 Id in the vertical direction 
used to generate one pixel of the fluorescence image has to be 
integral multiples of the number of cells 311d in the vertical 
direction used to generate one pixel of the normal image. 
[0184] In step S402, the MPU 401 controls the light source 
402 to emit UV light (i.e. , the excitation light) . Next, in step 
S403, the product of Ax and Px is assigned to a variable Bx, 
and the product of Ay and Py is assigned to a variable By. Then, 
the MPU 4 01 sends the variables Bx and By to the driver circuit 
304. The driver circuit 304 generates the timing signals based 
on the variables Bx and By. By performing the step S403, a frame 
of the image signal is outputted by the CDS circuit 305. 
[0185] Next, in step S404, the MPU 401 controls the A/D 
converter 405 and the DSP 403 to convert the image signal from 
the CDS circuit 305 to image data. The image data is then stored 
in the memory 404. The various parameters obtained by the MPU 
401 in step S102 of the main flow are used in the conversion 
process in step S404 . 

[0186] Hereafter, a frame of the digitized signal generated 
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by the A/D converter 405 is represented by P'(x,y) having the 
pixel number of Pnx/Bx x Pny/By (where 0^x<Pnx/Bx, 0^y<Pny/By) . 
The DSP 403 converts the P'(x,y) to image data F(x,y) . The 
F(x,y) represents an intensity value of one pixel data of the 
fluorescence image having the horizontal coordinate x and the 
vertical coordinate y, 

[0187] The DSP 403 determines the F(x,y) according to the 
following equations. 

0<;x<Pnx/Bx-l 

0<ry<Pny/By-l 

F(x,y)=P' (x,y) 

[0188] After the image data is obtained in step S404 # the 
fluorescence image obtaining process terminates. Then, control 
returns to step S105 of the main flow. 

[0189] The operation of the driver circuit 304, the CCD unit 
310 and the CDS circuit 305 when the Bx and By are transmitted 
from the MPU 401 to the driver circuit 304 will be described 
below. Fig. 20 is a timing chart showing the timing signals 
outputted by the driver circuit. 304 when the Bx and By are 
transmitted from the MPU 401 to the driver circuit 305. 
[0190] As show in Fig. 20, the driver circuit 304 outputs 
successive "By" <{>V1 pulses (i.e. , 2 pulses in the example shown 
in Fig. 13) and successive "By" <)>V2 pulses while the (j)Hl and 
4>H2 are high in order to transfer charge accumulated in each 
cell 311d vertically (i.e., downward in Fig. 10) by "By" steps 
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(i.e. , 2 steps in tlie example shown in Fig. 13) toward the HCCD 
311b. After the two successive 4>V1 pulses and the two successive 
<|)V2 pulses are asserted, (j)Hl pulses and <j>H2 pulses are asserted 
successively to transfer charges accumulated in cells 311e to 
the FDA 312, and $R pulses are also asserted to transmit the 
image signal from the CCD unit 310 to the CDS circuit 305. 
[0191] By inputting the <|)V1 pulses and <|>V2 pulses as 
described above, charges of n By" cells 311d (i.e., two cells 
311d in the example shown in Fig. 13) aligned in the vertical 
direction are added together in each cell 3 lie of the HCCD 311b. 
[0192] Fig. 21 is a timing chart showing in detail the timing 
of the pulse <|>H1 , pulse <j)H2 , pulse (J>R, Vout (i.e., the image 
signal) , the CDS pulse 1 and the CDS pulse 2 during a time period 
"b" indicated in Fig. 20. As shown in Fig. 21, the pulse (J>R is 
asserted one time while pulses <|>H1 are asserted Bx times (i.e. , 
two times in an example of Fig. 21) . Each pulse (j>R is asserted 
in synchronization with its corresponding pulse (|>H1 . 
[0193] When the <j>H2 pulse falls, charge accumulated in each 
cell 311e of the HCCD 311b is transferred leftward to its 
neighboring cell 31 le. The cj>H2 pulse is asserted Bx times (i.e. , 
two times in the example shown in Fig. 14) during an interval 
between two successive <}>R pulses. The FDA 312 starts to 
accumulate charge from the HCCD 311b after the <|>R pulse falls. 
Therefore, in the interval between two pulses <})R, charges of 
Bx cells 311e (i.e., charges of two cells 311e in the example 
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shown in Fig. 21) are added together into the FDA 312, and are 
converted to a voltage level by the FDA 312. 

[0194] The CDS pulse 1 is asserted just after the falling 
edge of the (j>R pulse, while the CDS pulse 2 is asserted just 
before the rising edge of the next 4>R pulse. Consequently, the 
CDS circuit 305 outputs voltage levels respectively 
corresponding to amplitudes S'l and S'2 indicated in Fig. 21. 
[0195] It is understood from the above explanation that each 
of the amplitude S ' 1 and amplitude S ' 2 corresponds to charges 
accumulated in successive Bx cells 311e in the HCCD 311b. In 
addition, as described above, charges of By (i.e., two cells) 
3 lid aligned in the vertical direction are added together in 
each cell 3 lie of the HCCD 311b. Therefore, each of the 
amplitude S ' 1 and amplitude S ' 2 corresponds to the sum of 
charges accumulated in cells 3 lid arranged in ByxBx matrix. 
[0196] As described above, Bx is the product of Ax and Px, 
and By is the product of Ay and Py. Therefore, by inputting the 
above mentioned timing pulses to the CCD unit 310 and the CDS 
circuit 305, the CDS circuit 305 outputs sequentially voltages 
levels, each of which corresponds to integral multiple of one 
pixel of the normal image. 

[0197] According to the embodiment of the invention, the 
image formed on the light receiving unit 311a can be amplified 
BxxBy times . 
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[0198] THIRD EMBODIMENT 

[0199] Hereafter, a third embodiment of the invention will 
be described. An endoscope system according to the third 
embodiment has the same hardware configuration as the second 
embodiment shown in Fig. 8. 

[0200] Fig. 22 shows a block diagram of the endoscope system 
3 according to the third embodiment of the invention. The 
endoscope system includes an endoscope (i.e., an electronic 
endoscope) 500, an endoscope processor 600 and a monitor 690. 
[0201] The endoscope 500 includes an objective lens 501, a 
CCD unit 510 on which an image is formed by the objective lens 
501, a fiber bundle (i.e., a light guide) 502, a driver circuit 
504, a CDS (Correlated Double Sampling) circuit 505, and an 
EEPROM (electrically erasable programmable ROM) 506. The 
endoscope processor 600 includes a MPU (microprocessor unit) 
601, a light source 602, a DSP (digital signal processor) 603, 
a memory 604, an A/D converter 605, a D/A converter 606 and a 
clock generator 607. 

[0202] A proximal end portion 502a of the fiber bundle 502 
is connected optically to the. light source 602. A distal end 
502b of the fiber bundle 502 is positioned at a distal end 503a 
of an insertion tube 503 of the endoscope 500. Light emitted 
from the light source 602 is transmitted through the fiber 
bundle 502 to illuminate the object from the distal end 502b 
of the fiber bundle 502. As described in detail later, the light 
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source 602 is capable of emitting sequentially normal light and 
the excitation light to obtain color images and fluorescence 
images , respectively . 

[0203] The objective lens 501 forms the image of the object 
which is illuminated by light from the light source 602 onto 
a light receiving surface of the CCD unit 510 driven by timing 
signals from the driver circuit 504. 

10204] The CCD unit 510 outputs an image signal in 
synchronization with the timing signals from the driver circuit 
504. The image signal corresponding to one frame of image is 
outputted by the CCD circuit during a time period including one 
emission period of light. 

[0205] The CDS circuit 505 receives the image signal from 
the CCD unit 510 and processes the image signal to generate a 
CDS signal having an appropriate form for the A/D converter 605 . 
The A/D converter 605 processes the CDS signal into digitized 
form. The digitized signal is transmitted from the A/D 
converter 605 to the DSP 603 in which image processing such as 
a Y-correction is performed on the digitized image signal to 
store the processed image signal as image data in the memory 
604. 

[0206] A frame of image data (captured by emission of normal 
light (i.e., white light)), and a frame of fluorescence image 
data (captured by emission of the excitation light) are stored 
in different areas of the memory 604. 
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[0207] The DSP 603 reads out the image data from the memory 
604, and combines them to display the combined image. Then, the 
combined image data is processed by the D/A converter 606 having 
a video encoder to generate an analog video signal (e.g., an 
NTSC signal). Then, the video signal is transmitted to the 
monitor 690. 

[0208] The above mentioned processes are performed under 
the control of the MPU 601 which executes various programs 
stored in, for example, a ROM embedded therein. That is, the 
MPU 601 controls the light source 602, the DSP 603, the memory 
604, the A/D converter 605 and the D/A converter 606. For 
example, a sampling rate of the A/D converter 605 is determined 
by the MPU 601. The sampling rate determined by the MPU 601 is 
used by the A/D converter 605 to digitize the CDS signal at the 
sampling rate, and is also used by the DSP 603 to generate the 
image data. The MPU 601 uses an area in the memory 401 as a work 
memory . 

[0209] The clock generator 607 generates a vertical 
synchronizing signal. The vertical synchronizing signal is 
sent to the driver circuit 504, the MPU 601, the DSP 603, and 
the A/D converter 605. The MPU 601 generates various control 
signals based on the vertical synchronizing signal to control 
the driver circuit 504, the light source 602, and the A/D 
converter 605. 

[0210] Under the control of the MPU 601, the switching 
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between the normal light emission and the excitation light 
emission, and an initiation of an image capturing operation of 
one frame are synchronized with the vertical synchronizing 
signal. The DSP 603 can determine which portion of the image 
signal sent from the endoscope 500 corresponds to one frame. 
[0211] The driver circuit 504 provided in the endoscope 500 
generates the timing signals based on the synchronizing signal 
from the clock generator 60 7 and sends the timing signals to 
the CCD unit 510 and the CDS circuit 505. 

[0212] In the EEPROM 50 6 of the endoscope 500, information 
regarding the CCD unit 510 is stored. The information of the 
CCD unit 510 is read out by the MPU 601, and is used for the 
control of the DSP 603, the driver circuit 604, and the CDS 
circuit 505. 

[0213] Fig. 23 shows a configuration of the CCD unit 510. 

The CCD unit 510 has the same architecture (i.e., the 
frame -transfer architecture) as the CCD unit 310 of the second 
embodiment shown in Fig. 9. Therefore, to some elements which 
are the same as those shown in Fig. 9, same numbers are assigned. 
[0214] As shown in Fig. 23, the CCD unit 510 includes a color 
CCD (charge coupled device ) 511, a Floating Diffusion Amplifier 
(i.e. , a charge detection amplifier) 512, and buffer B. The CCD 
511 Includes a light receiving unit 511a on which the image is 
formed by the objective lens 501, a horizontal transferring CCD 
(HCCD) 511b, horizontal pulse input terminals IH1 and IH2 , and 
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vertical pulse input terminals IV1 and IV2 . 

[0215] The light receiving unit 511a has a plurality of 
cells Slid arranged in a form of M by N pixel matrix. That is, 
the light receiving unit 511a has M rows of cells Slid and N 
columns of sells 511d. 

[0216] The HCCD 311b has N cells 311e arranged horizontally 
in a line and is adjacent to a side 51 If of the light receiving 
unit 511a. The number of cells 511e in the HCCD 511b is equal 
to the number of cells 311d arranged horizontally along the side 
511f . 

[0217] The cells 511e in the HCCD 511b are respectively 
connected to the cells Slid arranged along the side 511f . One 
of the cells 511e located at one end (leftward end in Fig. 23) 
of the HCCD 311b is connected to the FDA 512. 
[0218] The horizontal pulse input terminals IH1 and IH2, and 
the vertical pulse input terminals IV1 and IV2 are connected 
to the driver circuit 5£4, and receive the timing pulses from 
the driver circuit 504. Each of the vertical pulse input 
terminals IV1 and IV2 is connected to each cell Slid. Each of 
the horizontal pulse input terminals IH1 and IH2 is connected 
to each cell 511e in the HCCD 511b. 

[0219] While the image is formed by the objective lens 501 
on the cells 511d, charge is accumulated in each cell Slid. The 
amount of charge accumulated in each cell Slid depends on the 
accumulation period and a luminance of the optical image. Each 
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time a pair of pulses are inputted to the vertical pulse input 
terminals IV1 and IV2 , charge accumulated in each cell 511d is 
transferred vertically into its neighboring cell toward the 
HCCD 511b. Also, charges accumulated in cells 511d arranged 
along the side 511f are respectively transferred to the cells 
511e of the HCCD 511b. 

[0220] In this embodiment, charge is transferred vertically 
based on the two-phase transferring technology. However, 
another technology, such as a single phase transferring 
technology, three-phase transferring technology, and 
four-phase transferring technology well known in the art, may 
be adopted to transfer charge vertically. 

[0221] Each time a pair of pulses are inputted to the 
horizontal pulse input terminals IH1 and IH2, charge 
accumulated in each cell 511e is transferred horizontally (i.e., 
leftward in Fig. 23) to its neighboring cell. Also, charge 
accumulated in one of cells 511e located nearest to the FDA 512 
is transferred to the FDA 512. In this embodiment, charge is 
transferred horizontally in the HCCD 511b based on the 
two-phase transferring technology. However, another 
technology, such as a single phase transferring technology, 
three-phase transferring technology, and four-phase 
transferring technology well known in the art , may be adopted 
to transfer charge horizontally in the HCCD 511b. 
[0222] The FDA 512 accumulates the charge transferred from 



5.4 



Od- 3-29; 5: 19PM; MATSUOKA & Co. 



GreenblumlEernnei ; 0423726853 



# 5 7/113 



the HCCD 511b until a next reset pulse is inputted thereto. The 
FDA 512 outputs a voltage level corresponding to the charge 
accumulated therein. The FDA 512 has the switch SW which is 
switched to ON or OFF by control of the reset pulse from the 
driver circuit 504. 

[0223] When the reset pulse is inputted to the FDA 512, the 
charge accumulated therein is discharged, and thereafter next 
accumulation of charge starts . The voltage level generated by 
the FDA 512 is transmitted to the CDS circuit 505 through the 
buffer B. The buffer B may have the function of amplifying the 
voltage inputted therein. Thus, the image signal (i.e., Vout) 
generated by the CCD unit 510 is transmitted to the CDS circuit 
505. 

[0224] The CDS circuit 505 samples the image signal from the 
CCD unit 510 two times per one reset pulse (i.e., at a timing 
just after output of the reset pulse and at a timing just before 
output of the next reset pulse) to obtain a difference between 
amplitudes of the two values sampled between the reset pulse 
and the next reset pulse. The difference is outputted from the 
CDS circuit 505 to the A/D converter 605, According to the above 
mentioned operation of the CDS circuit 505, 1/f noise and reset 
pulse noise can be eliminated from the image signal outputted 
by the CDS circuit 505. 

[0225] Although in this embodiment the CCD 511 has the 
frame -transfer architecture, a CCD having an interline 



55 



04- 3-29; 5:19?M;MATSU0KA & Co. 



GreenDl umgiBerns t e i ; 0 423725858 



# 5 3/113 



architecture may be used in place of the CCD 511. Fig. 24 shows 
a CCD unit 2110 having the interline architecture. The CCD unit 
2110 includes a CCD 2111 having the interline architecture, a 
Floating Diffusion Amplifier (i.e., a charge detection 
amplifier) 2112, and a buffer B. 

[0226] The CCD 2111 includes N columns of light receiving 
linens 2111a on which the image is formed by the objective lens 
501, a horizontal transferring CCD (HCCD) 2111b, vertical 
transferring CCDs (VCCD) 2111h, horizontal pulse input 
terminals IH1 and IH2, and vertical pulse input terminals IV1 
and IV2. As shown in Fig. 24, each light receiving line 2111a 
has M cells 2111d aligned vertically. That is, the CCD 2111 has 
the M by N matrix of cells 21 lid for receiving light from the 
object. 

[0227] Neighboring to each light receiving line 2111a, one 
vertical transferring CCD (VCCD) 2111h is located. The VCCD 
2111h also includes M cells 21111 aligned vertically. Cells 
2111d in each light receiving line 2111a are respectively 
connected to the cells 21111 in the neighboring VCCD 2111h. 
Areas of the VCCDs 2111h are covered with optical shielding, 
and light from the object is not incident on the VCCDS 2111h. 
Therefore, only the cells 2111d of light receiving lines 2111a 
receive light from the object. 

[0228] The HCCD 2111b is located along one side 2111f of the 
CCD 2111. The HCCD 2111b has N cells 2111e which are aligned 
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in a line horizontally and which respectively correspond to the 
VCCDs 2111h. One of the cells 2111e located at one end (leftward 
end in Fig. 24) of the HCCD 2111b is connected to the FDA 2112. 
[0229] As in the case of the CCD 511 having the 
frame -transfer architecture , the horizontal pulse input 
terminals IH1 and IH2 , and the vertical pulse input terminals 
IV! and IV2 are connected to the driver circuit 504, and receive 
the timing pulses from the driver circuit 504. Each of the 
vertical pulse input terminals IV1 and IV2 is connected to each 
cell 211 Id. Each of the horizontal pulse input terminals IH1 
and IH2 is connected to each cell 2111e of the HCCD 2111b. 
[0230] While the image is formed by the objective lens 501 
on the cells 21 lid, charge is accumulated in each cell 2 11 Id. 
The amount of charge accumulated in each cell 2111d depends on 
the. accumulation period and a luminance of the optical image. 
Each time pulses are inputted to the vertical pulse input 
terminals IV1 and IV2 , charge transferred from each cell 2111d 
to each cell 21111 is transferred vertically to its neighboring 
cell toward the HCCD 2111b. Also, charges accumulated in cells 
211ld arranged along the side 2111f are respectively 
transferred to the cells 2llle of the HCCD 2111b. 
[0231] in this example shown in Fig. 24, charge is 
transferred vertically based on the two-phase transferring 
technology. However, another technology, such as a single phase 
transferring technology, three-phase transferring technology, 
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and four-phase transferring technology well known in the art, 
may be adopted to transfer charge vertically. 
[0232] Each time a pair of pulses are inputted to the 
horizontal pulse input terminals IH1 and IH2 # charge 
accumulated in each cell 2111e is transferred horizontally 
(i.e., leftward in Fig. 24) to its neighboring cell. Also, 
charge accumulated in one of cells 2111e located nearest to the 
FDA 2112 is transferred to the FDA 2112. In this example, charge 
is transferred horizontally based on the two-phase 
transferring technology. However, another technology, such as 
a single phase transferring technology, three-phase 
transferring technology, and four-phase transferring 
technology well known in the art, may be adopted to transfer 
charge horizontally. 

[0233] As described above, the CCD unit 2110 can be 
controlled in the same way as that of the CCD unit 510 . Functions 
of the FDA 2112 and the buffer B are the same as those shown 
in Fig. 23, detailed explanation thereof will not be repeated. 
[0234] Hereafter, an image processing performed under 
control of the MPU 601 provided in the endoscope processor 600 
will be described. As described below, images for normal 
observation (i.e., color images) and images for- fluorescent 
observation (i.e., fluorescence images) are obtained in the 
image processing. Fig. 25 is a flowchart (a main flow) showing 
the image processing. A program of the image processing is 
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stored, for example, in the embedded ROM and is read out by the 
MPU 601. 

[0235] Firstly, MPU 601 determines whether power of the 
endoscope 500 is ON or OFF (step S1101) . When the power of the 
endoscope 500 is OFF (S1101:NO), the MPU 601 repeats the step 
S1101. When the power of the endoscope 500 is ON (S1101:YES) r 
control proceeds to step S1102. 

[0236] In step SI 10 2, the MPU 601 reads out information from 
the EEPROM 506 and assigns various parameters to variables. In 
step 1103 , 1 is assigned to a variable FC (FC=1) , that indicates 
odd-field or even-field for video signal. Next, in step S1104, 
the image for the normal observation (i.e. , the normal image) 
is obtained. Next, in step S1105, the image for the fluorescent 
observation (i.e., the fluorescence image) is obtained. 
[0237] In step S1106, the image for normal observation 
obtained in step SI 10 4 and the image for the fluorescent 
observation obtained in step S1105 are combined. Then, the 
combined image is converted to the video signal and is outputted 
to the monitor 690. The video signal is outputted as an 
odd-field of an interlace scan signal when FC=1, and is 
outputted as an even-filed of the interlace scan signal when 
FC=0. 

[0238] Next, the MPU 601 determines whether FC is zero or 
not (S1107). When FC is 0 (S1107:YES), 1 is assigned to FC 
(S1108). When FC is 1 (S1107:NO), 0 is assigned to FC (S1120). 
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Then, in step S1109, the MPU 601 determines whether the power 
of the endoscope 500 is OFF. or ON. 

[0239] When the endoscope 500 is ON (S1109:NO), control 
returns to step S1104 to obtain a next field of the image. When 
the endoscope 500 is OFF (S1109:YES), the image processing 
terminates. According to the image processing shown Fig. 25, 
both of the image for the normal observation and the image for 
the fluorescent observation can be obtained and are displayed 
on the monitor 690. 

[0240] Fig. 26 is a flowchart showing an EEPROM read process 
performed in step S1102 of Fig. 25. 

[0241] Firstly, in step S1201,. the MPU 601 obtains the 
number of cells Slid provided in the light receiving unit 511a. 
More specifically, the MPU 601 obtains the number of cells Slid 
in one row (i.e., the cells Slid aligned in the horizontal 
direction) and the number of cells Slid in one column (i.e., 
the cells Slid aligned in the vertical direction) from the 
EEPROM 506. The MPU 601 assigns the number of cells Slid in one 
row to a variable Pnx, and assigns the number of cells Slid in 
one column to a variable Pny. 

[0242] As described above, in this embodiment, the cells 
Slid are aligned in M by N matrix. The number N is assigned to 
the Pnx and the number M is assigned to the Pny. 
[0243] On cells 511a of the color CCD 511, a color filter 
is formed. Examples of the color filter has been described with 
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reference to Figs. 13-15 of the second embodiment, these 
examples can also be used in the third embodiment. Therefore, 
explanations about examples of the color filters will not be 
repeated.. In this embodiment, the color filter shown in Fig. 
13 is used. v 

[0244] In step S1202, information concerning a repetition 
pattern of the filter elements of the color filter is read but 
from the EEPROM 506. More specifically, the information 
concerning the repletion pattern includes the number, of filter 
elements arranged in the horizontal direction in one group 91 
(see Fig. 13), and the number of filter elements arranged in 
the vertical direction in one group 91. 

[0245] In the case of the color filter shown in Fig. 13, the 
number of filter elements arranged in the horizontal direction 
in one group 91 is 2, and the number of filter elements arranged 
in the vertical direction in one group 91 is 2. These obtained 
numbers (2, 2) are stored in variables (AX, Ay), respectively. 
[0246] After the information concerning the repetition 
pattern of the filter elements is obtained in step S1202, 
control proceeds to step S1203. In step S1203, the MPU 601 
obtains an ±D number indicating the type of the color filter 
array pattern of the color filter in the color CCD 510 from the 
EEPROM 506. 

[0247] For example, the ID number of the type of the color 
filter array pattern is zero when the color filter shown in Fig. 
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13 is used, the ID number of the type of the color filter array 
pattern is 1 when the color filter shown in Fig. 14 is used, 
and the ID number of the type of the color filter array pattern 
is 2 when the color filter shown in Fig. 15 is used. The ID number 
of the type of the color filter array pattern is stored in a 
variable Pt . . 

[0248] After step S1203 is processed, control returns to 
step 1103 of the main flow (Fig. 25). 

[0249] Fig. 27 is a flowchart showing a normal image 
obtaining process performed in step SI 104 of the main flow (Fig. 
25). Firstly, in step S1301, 1 is assigned to each of the 
variables Px and Py. Next, in step S1302, normal light (i.e., 
white light) is emitted by the light source 602. 
[0250] In step S1303, the values of Px and. Py are sent to 
the driver circuit 504 . The driver circuit 504 uses the Px arid 
Py to generate timing signals to be inputted to the CCD unit 
510 and the CDS circuit 505. By performing the step S1303, the 
image signal corresponding to one field is outputted by the CDS 
circuit 505 to the A/D converter 605. 

[0251] In step S1304, the MPU 601 controls the A/D converter 
605 and the DSP 603 to store the digital signal digitized. Then, 
in step S1305, the MPU 601 controls the A/D converter 605 and 
the DSP 603 to convert the digitized image signal to image data 
and to store the image data in the memory 604. Various 
parameters obtained in step S1102 in the main flow is used in 
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the conversion step S1305. Hereafter, the digitized image 
signal corresponding to one field of one frame is represented 
by pixel data P(x,y) having resolution of PhxxPny where 0<;x<Pnx, 
0^y<Pny. 

[0252] Similarly to the conversion calculation in the 
second embodiment, the DSP 603 converts the pixel data P(x,y) 
to red, green and blue component image data of R(x,y), G(x,y) 
and B(x,y) using the above mentioned equations ( 1 ) - ( 3 ) , 
according to the type of the color filter. R(x,y) represents 
the red component intensity value of a pixel having coordinates 
(x,y) . G(x,y) represents the green component intensity value 
of a pixel having coordinates (x,y) . B(x,y) represents the blue 
component intensity value of a pixel having coordinates (x,y) . 
[0253] The digital image data of one pixel when the color 
filter shown in Fig. 13, Fig. 14 or Fig. 15 is used is thus 
obtained from charges accumulated in four or three cells 5 lid 
according to the above equations ( l") - ( 3 ) . 

[0254] After the above mentioned calculation is performed 
in step S1305 of Fig. 27, the normal image obtaining process 
terminates, and control returns to step S1105 of the main flow 
(Fig. 25) . 

[0255] Next, operation of the driver circuit 504, the CDS 
circuit 505 and the CCD unit 510 when the MPU 601 sends the Px 
and Py to the driver circuit 504 in step S1303 of Fig. 27 will 
be explained. Fig. 28 is a timing chart showing the timing 
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signals outputted by the driver circuit 504 when the driver 
circuit 504 receives the Px and Py from the MPU 601. That is, 
the timing chart shows operation when the image for the normal 
image is obtained. 

[0256] As shown in Fig. 28, the driver circuit 504 outputs 
a <j>Vl signal, a <f>V2 signal, a (j)Hl signal, a ())H2 signal and a 
<J)R signal (i.e. , the reset pulse) . The (j>Vl signal and the (}>V2 
signal are respectively inputted to the vertical pulse input 
terminals IV1 and IV2 of the CCD unit 510. The (j)Hl signal and 
the (j>H2 signal are respectively inputted to the horizontal 
pulse input terminals IH1 and IH2 of the CCD unit 510. The <j>R 
signal is inputted to the switch SW of the FDA 512. 
[0257] As shown in Fig. 28, when a pair of successive one 
<J>V1 pulse and one <|>V2 pulse is inputted to the input terminals 
IV1 and IV2 , charge accumulated in each cell 5 lid is transferred 
vertically (i.e., upward in Fig. 23) to its neighboring cell 
511d. Then, by respectively inputting the $H1 pulses and (j)H2 
pulses to the input terminals IH1 and IH2 , charge accumulated 
in each cell 511e in the HCCD 511b is outputted from the HCCD 
511b to the FDA 512. Further, by inputting the cf>R pulses to the 
CCD unit 510, the image signal is sent from the unit CCD 510 
to the CDS circuit 505. 

[0258] Fig. 29 is a timing chart showing the timing within 
a timing period "a" of Fig. 28 in detail. As shown in Fig. 18, 
the <}>R pulses are inputted to the CCD unit 510 in 
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synchronization with the <j)Hl pulses. Also, in Fig. 29, CDS 
pulses 1 and 2 which are sent from the driver circuit 504 to 
the CDS circuit 505 are indicated. ' 

[0259] The CDS circuit 505 samples the ijnage signal from the 
CCD unit 510 when the CDS pulse 1 is inputted thereto and when 
the CDS pulse 2 is inputted thereto.. Then the CDS circuit 505 
obtains a difference between amplitude of the image signal when 
the CDS pulse 1 is inputted and amplitude of the image signal 
when the CDS pulse 2 is inputted. 

[0260] More specifically, the CDS pulse 1 is asserted just 
after the falling edge- of the <|)R pulse, and is asserted just 
before the rising edge of the next <j)R pulse . Synchronizing with 
the falling edge of the.(|>H2 pulse, charge accumulated in each 
cell 511e of the HCCD 511b is transferred to its neighboring 
cell. The FDA 512 accumulates charge from the cell 511e of the 
HCCD 511b, and outputs the voltage level corresponding to the 
charge accumulated therein.. Consequently, a signal Vout (i.e. , 
the image signal) corresponding to the charge accumulated in 
the FDA 512 is output ted from the buffer B to the CDS circuit 
505. 

[0261] According to the above mentioned operation of the CCD 
unit 510 and the CDS circuit 505, the difference between 
amplitude of the image signal sampled when the CDS pulse 1 is 
asserted and amplitude of the image signal when the CDS pulse 
2 is asserted appropriately indicates the voltage level 
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corresponding to charge accumulated in the FDA 512. 
[0262] That is, the CDS circuit 505 outputs voltage levels 
respectively corresponding to voltage levels of SI, S2, S3 and 
S4 shown in Fig. 29 . As shown in Fig. 29 , one <|>R pulse is asserted 
per one ij>Hl pulse. Therefore /each of voltage levels SI, S2, 
S3 and S4 corresponds to charge accumulated, in one cell 511e. 
[0263] As describe above/ Charge accumulated in one cell 
Slid is transferred to each cell 511e of the HCCD 511b when the 
pair of signals cj>Vl and <j>V2 is asserted. Therefore, each of the 
voltage levels of SI, S2, S3 and S4 shown in Fig. 29 corresponds 
to onfe cell Slid of the light receiving unit 311a. 
[0264] Consequently, the CDS circuit 505 sequentially 
outputs voltage levels respectively corresponding to charges 
in the cells Slid. 

[0265] Fig. 30 is a flowchart showing in detail a process 
of obtaining the fluorescence image (hereafter, referred to as 
a fluorescence image obtaining process ) performed in step S1105 
of the main flow (Fig. 25). 

[0266] Firstly, in step S1401, pixel addition parameters 
are assigned to Px and Py. The pixel addition parameters 
represent the number of pixels of the normal image to be added 
together for generating one pixel of the fluorescence image. 
[0267] For example, if Px=2 and Py=3, intensities of two 
cell groups (e.g. , two color groups 91 in Fig . 13) aligned in 
the horizontal direction and intensities of three cell groups 
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aligned in the vertical direction are added together, and the 
sum is used as a!n intensity of one pixel of the fluorescence 
image. That Is, 2 by 3 pixel groups are used to generate one 
pixel of the fluorescence image. The pixel addition parameters 
may be set by a user to the endoscope processor 600 for example 
by user operation.. In this embodiment , Px and Py are even 
numbers . 

[0268] As described above, one color group (e.g. / the color 
group 91 in Fig. 13) of the color filter has different types 
of color filter elements. It is noted that the different types 
of color filter elements have different transmissivity . 
Therefore, in order to match a gray scale of the fluorescence 
image to a real image of the object, the number of cells Slid 
used for generation of one pixel of the fluorescence image has 
to be integral multiples of the number of cells Slid included 
in one color group. 

[0269] That is, the number of cells Slid in the horizontal 
direction used to generate one pixel of the fluorescence image 
has to be integral multiples of the number of cells Slid in the 
horizontal direction used to generate one pixel of the normal 
image. Also, the number of cells Slid in the vertical direction 
used to generate one pixel of the fluorescence image has to be 
integral multiples of the number of cells Slid in the vertical 
direction used to generate one pixel of the normal image. 
[0270] In step S1402, the MPU 601 controls the light source 
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602 to emit UV light (i.e. , the excitation light) . Next, in step 
S1403, the product of Ax and Px is assigned to a variable Bx, 
and the product of Ay and Py is assigned to a variable By. Then, 
the MPU 601 sends the variables Bx and By to the driver circuit 
* 504. The driver circuit 504 generates the timing signals based 
on the variables Bx and By. By performing the step S1403, the 
image signal corresponding to one field is outputted by the CDS 
circuit 505. 

[0271] Next, in step S1404, the MPU 601 controls the A/D 
converter, 605 and the DSP 603 to store digitized image signal 
D'(s) corresponding to one field. Then , in step S1405 , the MPU 
601 controls the A/D converter 605 and the DSP 603 to convert 
the digitized image signal from the CDS circuit 505 to image 
data. The image data is then stored in the memory 604. The 
various parameters obtained by the MPU 601 in step S1102 of the 
main flow are used in the conversion process in step S1405. 
[0272] Hereafter, a frame of the digitized signal generated 
by the A/D converter 605 is represented by P'(x,y) having the 
pixel number of Pnx/Bx x Pny /By (where 0<;x<Pnx/Bx, 0=sy<Pny/By) . 
The DSP 603 converts the P'(x,y) to image data F(x,y) . The 
F(x,y) represents an intensity value of one pixel data of the 
fluorescence image having the horizontal coordinate x and the 
vertical coordinate y. 

[0273] The DSP 603 determines the_F(x,y) according to the 
following equations. 
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0<sx<Pnx/Bx- 1 . 
Os;y<Pny/By-l 
F(x,y)=P' (x,y) 

[0274] After the image data is obtained in step S1405, the 
fluorescence image obtaining process terminates . Then, control 
returns to step S1106 of the main flow. 

[0275] The operation of the driver circuit 504, the CCD unit 
510 and the CDS circuit 505 when the Bx, By and FC are 
transmitted from the MPU 601 to the driver circuit 504 will be 
described below. Fig. 31 is a timing chart showing the timing, 
signals outputted by the driver circuit 505 when the Bx, By and 
FC (FC=1) are transmitted from the MPU 601 to the driver circuit 
505. 

[0276] As show. in Fig. 31, the driver circuit 504 outputs 
successive "By" (j>Vl pulses (i.e. , 4 pulses in the example shown 
in Fig. 31) and successive "fiy> cj)V2 pulses while the <j)Hl and 
(j)H2 are high in order to' transfer charge accumulated in each 
cell 51 Id vertically by "By" steps (i.e. , 4 steps in the example 
shown in Fig. 31) toward the HCCD 511b. After the four 
successive c|)Vl pulses and the four successive <|>V2 pulses are 
asserted, (j)Hl pulses and (j)H2 -pulses are asserted successively 
to transfer charges accumulated in cells 511e to the FDA 512, 
and <j>R pulses are also asserted to transmit the image signal 
from the CCD unit 510 to the CDS circuit 505. 
[0277] By inputting the (j>Vl pulses and <j>V2 pulses as 
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described above, charges of By cells Slid (i.e. , four cells Slid 
in the example shown in Fig. 31) aligned in the vertical' 
direction are added together in each cell Slle of th6 HCCD 511b. 
[0278] Fig. 32 is a timing chart showing in detail the timing 
of the (|>H1, <j>H2, (j>R, Vout (i.e. , the image signal) , the CDS pulse 
1 and the CDS pulse 2 during a time period n b" indicated in Fig. 
31. As shown in Fig. 32, the cf>R pulse is asserted one time while 
<j)Hl pulses are asserted Bx times (i.e. , four times in an example 
of Fig. 32) . Each (j)R pulse is asserted in synchronization with 
its corresponding pulse 4>Hi . 

[0279] When the (j)H2. pulse falls, charge accumulated in each 
cell 511e of the HCCD 511b is transferred leftward to its 
neighboring cell Slle. The <j>H2 pulse is asserted Bx times (i.e. , 
four times in the example shown in Fig. 32) during an interval 
between two successive <J>R pulses. The FDA 512 starts to 
accumulate charge from the HCCD 511b after the 4>R pulse falls. 
Therefore, in the interval between the two (f>R pluses, charges 
of Bx cells 5 lie (i.e. , charges of four cells Slle in the example 
shown in Fig. 32) are added together into the FDA 512, and are 
converted to a voltage level by the FDA 512. 

[0280] The CDS pulse 1 is asserted just after the falling 
edge of the (j)R pulse, while the CDS pulse 2 is asserted just 
before the rising edge of the next <|>R pulse. Consequently, the 
CDS circuit 505 outputs voltage levels respectively 
corresponding to amplitudes SI' and S2 ' indicated in Fig . 32 . 
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[0281] It is understood from the above explanation that each 
of the amplitude SI' and amplitude S2 ' corresponds . to charges 
accumulated in successive Bx cells 511e in the HCCD 511b. In 
addition, as described above, charges of By (i.e. , four) cells 
511d aligned in the vertical direction are added together in 
each cell 5 lie of the HCCD 511b. Therefore, each of the 
amplitude SI' and amplitude S2 ' corresponds to the sum of 
charges accumulated in cells 3 lid arranged in ByxBx matrix, 
[0282] As described above, Bx is the product of Ax and Px, 
and By is the product of Ay and Py. Therefore, by inputting the 
above mentioned timing pulses to the CCD unit 510 and the CDS 
circuit 505, the CDS circuit 505 outputs sequentially voltages 
levels, each of which corresponds to integral multiple of one 
pixel of the normal image. 

[0283] Fig. 33 is a timing chart showing the timing signals 
outputted by the driver circuit 505 when the Bx, By and FC (FC=0) 
are transmitted from the MPU 601 to the driver circuit 505 in 
step S1403 of Fig. 30. 

[0284] As show in Fig. 33, the driver circuit 504 outputs 
successive "By" <j)Vl pulses (i.e. , 4 pulses in the example shown 
in Fig. 33) and successive "By" <j>V2 pulses while the (j>Hl and 
(J>H2 are high in order to transfer charge, accumulated in each 
cell 5 lid vertically by n By" steps (i.e. , 4 steps in the example 
shown in Fig. 33) toward the HCCD 511b. After the four 
successive (})V1 pulses and the four successive (j)V2 pulses are 

i 
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asserted, (j)Hl pulses and (j)H2 pulses are asserted successively 
to transfer charges accumulated in cells 511e to the FDA 512, 
and (j)R pulses are also asserted, to transmit the image signal 
from the CCD unit 510 to the CDS circuit 505. 
[0285] By inputting the (j>Vl pulses and (j)V2 pulses as 
described above , charges of By cells Slid (i.e. , four cells Slid 
in the example shown in Fig. 33) aligned in the vertical 
direction are added together in each cell 511e of the HCCD 511b. 
[0286] In contrast to the case of FC=1, at the top of the 
field, only By/2 (i.e. , two) successive <j>Vl pulses and 
successive By/ 2 (i.e. , two) 4>V2 pulses are asserted when FC is 
0. 

[0287] Fig. 34 is a timing chart showing in detail the timing 
of the <(>H1, <t>H2, ((>R, Vout (i.e. , the image signal) , the CDS pulse 
1 and the CDS pulse 2 during a time period "c" indicated in Fig. 
33. As shown in Fig. 34, the <j)R pulse is' asserted one time while 
4>H1 pulses are asserted Bx times (i.e. , four times in an example 
of Fig. 34) . Each <j>R pulse is asserted in synchronization with 
its corresponding pulse (J)H1> 

[0288] However, in contrast to the case when FC is 1, the 
(|)R pulse is asserted one time while <j>Hl pulses are asserted Bx/2 
times. (i.e., two times in an example of Fig. 34). 
[0289] When the $H2 pulse falls, charge accumulated in each 
cell 511e of the HCCD 511b is transferred leftward to its 
neighboring cell 511e. The 4>H2 pulse is asserted Bx times (i.e.. , 
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four times in the example shown in Fig. 34) during an interval 
between two successive (j>R pulses. The FDA 512 starts to 
accumulate charge from the HCCD 511b after the (J)R pulse falls. 
Therefore, in the interval between the two <j>R pluses, charges 
of Bx cells' 5 lie (i.e. , charges of four cells 5 lie in the example 
shown in Fig. 34) are added together into the FDA 512 , and are 
converted to a voltage level by the FDA 512. 

[0290] The CDS pulse 1 is asserted just after the falling 
edge of the <f)R pulse/ while the CDS pulse 2 is asserted just 
before the rising edge of the next <}>R pulse. Consequently, the 
CDS circuit 505 outputs voltage levels respectively 
corresponding to amplitudes S3 ' , S4 ' , S5 ' and S6 ' indicated in 
Fig. 34. . . 

[0291] The amplitude S3 ' corresponds to a first output of 
the top line of the filed, the amplitude S4 ' corresponds to a 
second output of the top line of the field, the amplitude S5 ' 
corresponds to a first output of the second line of the field, 
and the amplitude S6 9 corresponds to a second output of the 
second line of the field. 

[0292] It is understood from the above explanation that each 
of the amplitude S3' and amplitude S5 ' corresponds to charges 
accumulated in successive Bx/2 cells 511e in the HCCD 511b, and 
that each of the amplitude S4 ' and amplitude S6 ' corresponds 
to charges accumulated in successive Bx cells 51 le in the HCCD 
511b. In addition, as described above, charges of By (i.e.. 
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four) cells Slid aligned in the vertical direction are added 
together in each cell 511e of the HCCD 511b except for an 

r 

exception in which By/ 2 cells Slid aligned in the vertical 
direction are added together in each cell 511e with regard, to 
the top line of the field. 

[0293] Therefore, the amplitude S3' corresponds to the sum 
of charges accumulated in Bx/2xBy/2 cells 3 lid, the amplitude 
S4' corresponds to' the sum of charges accumulated in BxxBy/2 
cells 311d, the amplitude S5 ' corresponds to the sum of charges 
accumulated in Bx/2xBy cells 311d, and the amplitude S6 ' 
corresponds to the sum of charges accumulated in BxxBy cells 
311d. 

[0294] As described above, Bx is the product of Ax and Px, 
and By is the product, of Ay and Py. Therefore, by inputting the 
above mentioned timing pulses to the CCD unit 510 and the CDS 
circuit 505 , the CDS circuit 505 outputs sequentially voltages 
levels, each of which corresponds to integral multiple of one 
pixel of the normal image, 

[0295] According to the embodiment of the invention, the 
image formed on the light receiving unit 511 can be amplified 
BxxBy times when the Interlace scan image is obtained. 
[0296] Fig. 35 shows the upper left portion of the CCD 511 
on which the color filter shown in Fig. 13 is formed, 
schematically illustrating cells Slid which are used to 
generate one field of the fluorescence image when the 
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parameters are FC=1,' Ax=2, Ay=2, Px=2 and Py=2. In Fig. 35 , the 
cells Slid indicated by hatching patterns (i.e., cells Slid 
surrounded by a heavy line box) are used to generate one field 
of the fluorescence image when the parameters are FC=1, Ax=2, 
Ay=2, Px=2 and Py=2 . Each cell group surrounded by the heavy 
line box, which is represented by a dot PI, corresponds to one 
pixel of the fluorescence image. 

[0297] Fig. 36 shows the upper left portion of the CCD 511 
on which the color filter shown in Fig. 13 is formed, 
schematically illustrating cells Slid which are used to 
generate one field of the fluorescence image when the 
parameters are FC=0, Ax=2, Ay=2, Px=2 andPy-2, In Fig. 36, the 
cells Slid indicated by hatching patterns (i.e., cells Slid 
surrounded by a heavy line box) are used to generate one field 
of the fluorescence image when the parameters are FC=1, Ax=2, 
Ay=2, Px=2 and Py=2. Each cell group surrounded by the heavy 
line box, which is represented by a dot P0 , corresponds to one 
pixel of the fluorescence image. 

[0298] As can be seen from Figs. 35 and 36, a position of 
each cell group P0 in the even field of the image is shifted 
by half pixel size in the horizontal direction and in the 
vertical direction in comparison with a position of each cell 
group PI in the odd field of the image. That is, a position on 
the cells 5 lid when the even field is obtained is different from 
position on the cell Slid when. the odd field is obtained even 
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if the coordinates on the fluorescence image, are the same. 
[0299] The resolution of each field of the interlace scan 
image becomes Pxn/Bx pixels in the horizontal direction and 
Pyn/By/2 in the vertical direction. 

[0300] Although the present invention has been described in 
considerable detail with reference to certain preferred 
embodiments thereof, other embodiments are possible. 
[0301] The present disclosure relates to the subject 
matters contained in Japanese Patent Applications No. 
P2003-094996, filed on March 31, 2003, No. P2003-094997 , filed 
on March 31, 2003, and No . P2003-094998 , filed on March 31 , 2003 , 
which are expressly incorporated herein by reference in their 
entireties. 
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